An upper limit on additional neutrino mass eigenstate in 2 to 100 eV region from 

"Troitsk nu-mass" data 
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We performed a search for any sign of an additional neutrino mass state in /3-electron spectrum 
based on data reanalysis of direct electron antineutrino mass measurements in Tritium beta-decay 
in the Troitsk nu-mass experiment. The existing data set allows us to search for such a state in 
the mass range up to 100 eV. The lowest value at a 95% C.L. upper limit for the contribution of a 
heavy eigenstate into electron neutrino is around or less than 1% for masses above 20 eV. 



Throughout the last couple decades it has become clear that the Standard Model (SM) of elementary particles 
cannot explain some of the observed phenomena in particle physics, astrophysics and cosmology. These are baryon 
asymmetry, dark matter, neutrino oscillations and others. Neutrino oscillations from short baseline experiments favor 
the existence of an additional neutrino mass state to the three active neutrinos in the SM. Astrophysical observations 
and cosmology also point to the fact that the effective number of neutrinos is greater than 3 [1]. This can be 
interpreted as a possible existence of at least one sterile neutrino. Sterile neutrino is a natural consequence of the 
non-zero neutrino mass and appears in many theories beyond the SM. From this point of view, addition of a. Would a 
t-H ' sterile neutrino be found it will be the first particle beyond the Standard Model. While there is a number of the results 
which disfavor or even are in contradiction with the hypothesis of sterile neutrino, many experiments are undergoing 
or are planning to search for them. For details we refer to the "Light sterile neutrinos: a white paper" 
, It becomes important to check all possible experimental data to prove, disprove or set an upper limit for the sterile 
' ■ neutrino hypothesis. Results of the reanalysis of our data on the direct electron antineutrino mass measurements in 
Tritium /3-decay in the Troitsk nu-mass experiment Q are presented in this paper. The group led by V. M. Lobashev 
<-j ■ was obtaining these data in the period of 1997-2004. We used the same file set and analysis framework as for the 
electron antineutrino mass. We performed a search for any sign of an additional neutrino mass state in the /3-electron 



spectrum. Such a state with a finite mass would exhibit itself as a kink in the spectrum. Recently a similar analysis 
was published based on the Mainz data [3[. 
, The Troitsk experiment has two major parts: an integrating electrostatic spectrometer with adiabatic magnetic 
^\ • collimation and a windowless gaseous tritium source as a volume for /3-decays. The spectrometer resolution was about 
4 eV. We measured an integrated electron spectrum at the region of the last 200-300 eV from the spectrum endpoint 
(18575 eV) by varying the electrostatic potential V on the spectrometer electrode. All details on experimental setup, 
data taking, analysis, corrections and estimation of systematic error are published in Ref. For electron antineutrino 
mass squared we published the value m 2 = —0.67 ± 2.53 e V 2 . 
(N) ' In accordance with Ref. [4[ , the spectrum of electrons in tritium /3-decay is the following: 



S(E, E ,ml) = NF(E)(E + m e ) Pe {E - E) ■ \J (E — E) 2 - m 2 , (1) 

where N is the normalization constant, F{E) - the so called Fermi-function responsible for electrostatic interaction 
between electron and nucleus, E and p e stand for the electron energy and momentum, Eo - for the beta-spectrum 
endpoint and m v - for the neutrino mass. After decay of a tritium nucleus the primary molecule of T2 becomes a 
molecule of T 3 He. Often, with a probability of about 43%, T 3 He does not go to its ground state, thus we have to 
sum over all molecule final states i and eq. [T] should be replaced by the sum: 

S(E,E ) = J2S(E,E -E i )-P i , (2) 

i 

where Si is the energy of the excited state and Pi is its probability, the sum of Pi equals one. Finally, we get the 
following expression for the experimental integrated electron spectrum versus retarding potential on the spectrometer 
electrode V: 

Sp{V) = N ■ J [S(E, E ,ml) ® Tr{E)} ■ R(V, E)dE + bkgr, (3) 

where S(E, Eg, m 2 ,) is the electron spectrum from the /3-decay, Eq. O Tr(E) is the energy loss spectrum and R(V, E) 
is the resolution function (see [3] for details), and bkgr is the experimental background. 

If the number of neutrino eigenstates is larger than 3, for the effective electron neutrino we can write | v e ) = 
^}2U e i I Vi), where U e i are the mixing matrix elements. We restrict ourselves to one additional heavy neutrino 
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(i = 4). From neutrino oscillation results it is known that the mass splitting between active neutrinos is much less 
than one electronvolt. Thus, masses of "normal" eigenstates are probably negligibly small, and one can assume 
mi = rti2 — — 0. Consequently, the electron spectrum with one additional heavy neutrino component can be 
written in the following way: 

S{E)dE = NF{E)(E + m e ) Pe {E - E) ■ (U 2 e4 ^ (E - Ef - m\ + (1 - U* A )(E - E)), (4) 

where U 2 4 is the fraction of the heavy neutrino in the electron neutrino and 1TI4 is the mass of the heavy neutrino 
eigenstate. In other words, we fit the spectrum with an assumption that its major component has a relative amplitude 
1 — U 2 4 and is attributed to zero neutrino mass, besides there is an additional feature with the relative amplitude U? 4 
for heavy mass m^. It is worth mentioning that in a usual notation for the neutrino oscillations parameter sin 2 (29) [5j, 
at small U 2 4 there is an approximate relation sin 2 (26) » AU 2 . 

To get an upper limit for U 2 4 the Bayesian approach has been used for the parameter estimation. The posterior 
probability L for parameter U 2 4 is calculated as a product of posterior probabilities Lk for different experimental runs 
(L = Y[Lk)- For each run the probability calculation procedure is the following: 

1. At first we set U 2 4 to zero and fit three spectrum parameters: Eq, N and bkg. This is required to get a precise 
region for the additional parameters. One must note that, while Eq is a physical value and should not change 
from run to run, in practice it is a free parameter and depends on the spectrometer calibration and can vary for 
different data sets. 

2. Next step: set m 2 and get a four-dimensional likelihood function L(U 2 4 , Eq, N,bkg). 

3. In order to take into account possible correlations between parameters, we marginalize the likelihood function 
over all non-essential parameters: L(U 2 4 ) = j J J L(U 2 4 ,Eq,N ,bkg). Due to the fact that the calculation of 

E N bkg 

the likelihood function for one set of parameters is greatly time consuming, integration is made by Monte-Carlo 
procedure. The values of L(U 2 4 ) are saved in the table. 

4. Repeat the procedure from step 2 for different values of m 2 . 

During all calculations we presume that < U 2 4 < 1. Finally an upper limit has been found by solving the equation: 

limit 

-1 =«, (5) 

JL(U 2 4 ) 


where a is the required confidence level, namely 95 %. 

In the current analysis we used only the data in which the spectrometer electrode potential is higher than Ei ow = 
18400 V. We also checked that the usage of Ei ow = 18300 V does not change the result. 

It is worth stressing that all statistical errors and correlations are already incorporated in the upper limit estimation 
by Eq. [SJ As for systematical errors, the shift of the upper limit at 95% C.L. caused by the change of one or more 
additional parameters within systematic boundaries proved to be negligibly small. A large error was expected to 
arise from uncertainty in the final states spectrum (FSS) of T 3 He, Eq. [2] Using the spectrum from Q and p} we get 
practically the same result. It should be emphasized that there are no experimental data for FSS of T 3 He molecule 
and in both references FSS was calculated. The whole analysis procedure was tested on simulated data. 

Results on the upper limit at 95% C.L. for additional neutrino mass eigenstate, m 4 , are presented in Fig. [TJ As 
expected, our experiment with a sensitivity limit of about 2 eV [J] has a poor rejection factor at m 4 of about a few 
electronvolts. At larger masses the limit goes down, then at the range 7714 = from 20 eV to 100 eV the upper limit 
stays between 0.01 and 0.005 . 

The important feature of the raw data processing is the so called bunch rejecting algorithm. Its main purpose is 
to filter short-timed high intensity "bunch" events which are caused by the electrons trapped in the spectrometer 
magnetic bottle. The procedure for "bunch" search is automatic and its effectiveness is lower for higher count rates. 
The count rate in the spectrometer below the spectrum endpoint by around 50 eV is usually critical for bunch rejection 
algorithm. The simulations show that while bunch rejection parameters cannot affect the estimation of the active 
neutrino mass, they do affect estimation of the probability for heavy neutrino mass above 30 eV. Our analysis is also 
not sensitive enough in the region of 7714 50 - 100 eV because of wider intervals between the measured experimental 
points (around 25 eV) of electron spectrum moving away from the endpoint. 
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FIG. 1: The upper 95% C.L. limit for admixture U^4 of the heavy neutrino eigenstate in /3-electron spectrum versus its mass, 

7714. 

In conclusion, we reanalyzed our data of the direct electron antincutrino mass measurements in Tritium /3-decay 
in the Troitsk experiment. The file set and the analysis framework were identical to those used in the original 
work. The maximum likelihood method was used to evaluate a possible contribution of the heavy extra mass state 
1124. with amplitude t/g 4 with the assumption that all three active neutrinos have zero masses. In the mass range 
2 < TO4 < 20 eV an upper limit at 95% C.L. quickly goes down to U^ 4 = 0.01 and then stays close to this level for 
1T14 up to 100 eV. 
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